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DETAILED ACTION 
Claim Rejections - 35 USC § 101 

1. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

Claims 25-35 are rejected under 35 U.S.C. 101 because the claimed invention is 

directed to non-statutory subject matter. The cited claims detail a software system 

having a plurality of components, i.e. a multi-modal manager, a kernel, and an API. 

There is no tangible component of the software system which is required under 

M.P.E.P. 2106 to be a statutory machine. 

Claim Rejections - 35 USC § 103 

2. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 1 02 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

3. Claims 25, 27, 28, 34-36, 97-99 and 103 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over "Adaptive Multimedia Interfaces in PolyMestra" by GLINERT. 

As to claims 25 and 27, GLINERT teaches a conversational computing system, 
comprising: a multi-modal CUI manager, operatively connected to a plurality of I/O 
Tenderers (visual display), which can receive input queries and input events across 
different user interface modalities of different active applications (applications) and 
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generate output messages and output events in connection with the active applications 
in one or more of the different user interface modalities (via the presentation manager) 
(pg. 8-9, Inter-application communication; pg. 4, "In our architecture... Presentation 
manager... ."); a conversational kernel for generating multi-modal dialogs in response to 
the input queries and input events and for managing context associated with the active 
applications (via the presentation manager) (pg. 8-9, Inter-application communication; 
pg. 4, "In our architecture... Presentation manager...."); and a conversational API for 
providing an interface between the active applications and the conversational kernel 
(Windows Dynamic Data Exchange management Library) (pg. 8, "In order for the core 
software tools to monitor the load... for this purpose). It would be obvious to one of 
ordinary skill in the art that the presentation manager of GLINERT functions both as the 
CUI manager and conversational kernel since both receive input event and queries and 
have no relation to one another. 

As to claim 97, GLINERT teaches a virtual machine (multimodal architecture) 
comprising: a kernel adapted to manage dialog and context, conversational engine and 
resources (resource monitor / resource data / metawidget data / user preferences) and 
communication across different applications (applications), each having one or more 
different user interface modalities, to provide a coordinated, universal conversational 
user interface across the different user interface modalities (via the presentation 
manager) (pg. 8-9, Inter-application communication; pg. 4, "In our 
architecture... Presentation manager...."); and an API comprising abstractions adapted 
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to access conversational services from the kernel on behalf of the applications 
(Windows Dynamic Data Exchange management Library) (pg. 8, "In order for the core 
software tools to monitor the load... for this purpose). It would be obvious to one of 
ordinary skill in the art that the multimodal architecture is stored on a computer medium 
to be later implemented on a system. 

As to claim 28, GLINERT teaches the kernel service is conversational 
customization (via handling presentation of information so that the user does not 
become overloaded) (pg. 4). 

As to claims 34-36, GLINERT teaches a multimodal software system executing 
on a multimedia computing environment (pg. 4-5; fig. 3). It would be obvious that the 
software machine executes on top of the windows operating system since the 
WindowsDDEML is used for inter-application communication (pg. 8). 

As to claims 98 and 99, GLINERT teaches a multimodal software system 
executing on a multimedia computing environment (pg. 4-5; fig. 3). It would be obvious 
that the software machine, i.e. virtual machine, executes on top of the windows 
operating system since the WindowsDDEML is used for inter-application communication 
(P9- 8). 
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As to claim 103, GLINERT substantially teaches the invention above. However, 
GLINERT does not teach that the applications are implemented one of declaratively, 
imperatively, and a combination thereof. Official Notice is taken in that it is well known 
in the art that an application can be implemented declaratively and/or imperatively and 
therefore would be obvious in view of GLINERT in order to develop an application. 

4. Claims 26, 100 and 104 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over "Adaptive Multimedia Interfaces in PolyMestra" by GLINERT in view 
of "Two Case Studies of Software Architecture for Multimodal Interactive Systems: 
Voice-Paint and a Voice-enabled Graphical Notebook" by GOURDOL et al. 

As to claim 26, GLINERT teaches a conversational engine to process the input 
queries and input events and to generate the multi-modal dialog and output events (via 
the presentation manager communicating with a resource monitor and other data, i.e. 
user preferences, metawidget data, and resource data) (see figure 2; and page 4). 
However, GLINERT does not teach a conversational engine API used to communicate 
with the conversational engine. 

GOURDOL teaches a multimodal architecture wherein a kernel component, i.e. a 
dialogue controller manages conversational engines (functional core) through an API 
(interface with functional core) (see pages 6-8). Therefore, it would be obvious to one 
of ordinary skill in the art to combine the teachings of GLINERT with the teachings of 
GOURDOL in order to identify software architecture components through the 
presentation of available multimodal systems (pg. 1, introduction). 
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As to claims 100 and 104, GLINERT substantially discloses the invention above. 
However, GLINERT does not teach a conversational engine API used to communicate 
with the conversational engine. 

GOURDOL teaches a multimodal architecture wherein a kernel component, i.e. a 
dialogue controller manages conversational engines (functional core) through an API 
(interface with functional core) such that a task is run by invoking the functional core 
(see pages 6-8). Therefore, it would be obvious to one of ordinary skill in the art to 
combine the teachings of GLINERT with the teachings of GOURDOL in order to identify 
software architecture components through the presentation of available multimodal 
systems (pg. 1, introduction). 

Allowable Subject Matter 

5. Claims 29-33, 37-59, 101, 102, 105-1 15 and 117-122 are objected to as being 
dependent upon a rejected base claim, but would be allowable if rewritten in 
independent form including all of the limitations of the base claim and any intervening 
claims. 

Response to Arguments 

6. Applicant's arguments with respect to claims 25-59, 97-1 1 5 and 1 1 7-222 have 
been considered but are moot in view of the new ground(s) of rejection. 
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Conclusion 



Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Lewis A. Bullock, Jr. whose telephone number is (571) 
272-3759. The examiner can normally be reached on Monday-Friday, 8:30 a.m. - 5:00 
p.m.. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Meng An can be reached on (571 ) 272-3756. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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